Early Stopping Criteria for Levenberg-Marquardt Based Neural Network Training Optimization
نویسندگان
چکیده
منابع مشابه
Modified Levenberg-Marquardt Method for Neural Networks Training
In this paper a modification on Levenberg-Marquardt algorithm for MLP neural network learning is proposed. The proposed algorithm has good convergence. This method reduces the amount of oscillation in learning procedure. An example is given to show usefulness of this method. Finally a simulation verifies the results of proposed method. Keywords—Levenberg-Marquardt, modification, neural network,...
متن کاملParallel Levenberg-Marquardt-Based Neural Network Training on Linux Clusters - A Case Study
This paper addresses the problem of pattern classification using neural networks. Applying neural network classifiers for classifying a large volume of high dimensional data is a difficult task as the training process is computationally expensive. A parallel implementation of the known training paradigms offers a feasible solution to the problem. By exploiting the massively parallel structure o...
متن کاملCalibration of an Inertial Accelerometer using Trained Neural Network by Levenberg-Marquardt Algorithm for Vehicle Navigation
The designing of advanced driver assistance systems and autonomous vehicles needs measurement of dynamical variations of vehicle, such as acceleration, velocity and yaw rate. Designed adaptive controllers to control lateral and longitudinal vehicle dynamics are based on the measured variables. Inertial MEMS-based sensors have some benefits including low price and low consumption that make them ...
متن کاملImproved computation for Levenberg-Marquardt training
The improved computation presented in this paper is aimed to optimize the neural networks learning process using Levenberg-Marquardt (LM) algorithm. Quasi-Hessian matrix and gradient vector are computed directly, without Jacobian matrix multiplication and storage. The memory limitation problem for LM training is solved. Considering the symmetry of quasi-Hessian matrix, only elements in its uppe...
متن کاملTraining recurrent network with block-diagonal approximated Levenberg-Marquardt algorithm
In this paper, we propose the block-diagonal matrix to approximate the Hessian matrix in the Levenberg Mar-quardt method in the training of neural networks. Two weight updating strategies, namely asynchronous and synchronous updating methods were investigated. Asyn-chronous method updates weights of one block at a time while synchronous method updates all weights at the same time. Variations of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Engineering & Technology
سال: 2018
ISSN: 2227-524X
DOI: 10.14419/ijet.v7i4.36.25382